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ABSTRACT 


A communication system easy to be operated upon as to the 
display method of images generated by image generating 
units of a plurality of communication terminals and as to the 
control of each image generating unit. The communication 
system has a reception unit for receiving images generated 
by image generating units of a plurality of communication 
terminals, an output unit for outputting a multi-image of 
images received by the reception unit to a display unit, a 
designation unit for designating an arbitrary image from the 
images constituting the multi-image, and a processing unit 
for controlling the output form of an image to be output to 
the display unit, the image being designated by the desig- 
nation unit, if a designation operation by the designation unit 
is a first designation operation, and for setting the commu- 
nication terminal as a control object, the communication 
terminal generating an image designated by the designation 
unit, if a designation operation by the designation unit is a 
second designation operation. 

29 Claims, 20 Drawing Sheets 
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COMMUNICATION SYSTEM AND METHOD 

AND STORAGE MEDIUM FOR STORING 
PROGRAMS IN COMMUNICATION SYSTEM 

BACKGROUND OF THE INVENTION 5 

1. Field of the Invention 

The present invention relates to a communication system 
and method, and a storage medium storing programs in 
communication system. 10 

2, Related Background Art 

A remote monitor system using a plurality of video 
cameras and a synthesizer for synthesizing in an analog 
manner images taken with the cameras has been used in a 
building of a relatively small scale or the like and such as 15 
system is called a local monitor system. In contrast to such 
a local monitor system, a remote monitor system has been 
proposed in which a plurality of cameras are connected by 
a digital network such as LAN (local area network) and 
public digital line ISDN so that the more cameras at remoter 20 
sites can be controlled more flexibly. 

Of remote monitor systems, some systems control the 
image display and system operations through graphical user 
interface (GUI) by using personal computers or work sta- 
tions as monitor terminals- Use of GUI at a monitor terminal 25 
enables a computer device to operate the system easily. The 
operability of the system can be improved by displaying a 
camera control panel together with an image taken with the 
camera. 

However, conventional methods of displaying images 30 
with such a system include various methods such as a glance 
display of images taken with a plurality of cameras. A 
conventional display operation and discrimination between 
system operations are not always good heretofore. Personal 
computers and work stations are directly, or via a synthesizer 35 
for image synthesis and a switcher for switching between 
cameras, connected to the network. The image synthesizer 
can select one of cameras connected thereto to display its 
image, or can display a plurality of images side by side at the 
same time. By using the switcher, any desired camera can be 40 
selected to be controlled. 

However, the operability of the system which inputs 
images via the switcher/synthesizer is not so much satisfac- 
tory and there is still a room to be improved. 45 

SUMMARY OF THE INVENTION 

It is an object of the present invention to solve the above 
problems and provide a communication system and method 
and a storage medium storing communication system 50 
programs, capable of providing flexible operations. 

It is another object of the present invention to provide a 
communication system and method having user interface 
(UI) capable of being flexibly operated upon and provide a 
communication system and method and a storage medium 55 
storing communication system programs, capable of 
switching, when necessary, between a glance display mode 
of displaying images supplied from a plurality of commu- 
nication terminals and a fine display mode of displaying a 
single image taken with each camera. 60 

According to one aspect of the present invention achiev- 
ing the above objects, a communication system comprises 
reception means for receiving images generated by image 
generating units of a plurality of communication terminals, 
output means for outputting a multi-image of images 65 
received by the reception means to a display unit, designa- 
tion means for designating an arbitrary image from the 


376 Bl 

2 

images constituting the multi-image, and processing means 
for controlling the output form of an image to be output to 
the display unit, the image being designated by the desig- 
nation means, if a designation operation by the designation 
means is a first designation operation, and for setting the 
communication terminal as a control object, the communi- 
cation terminal generating an image designated by the 
designation means, if a designation operation by the desig- 
nation means is a second designation operation. 

It is another object of the present invention to improve the 
operability of the system when images are supplied via a 
switcher or synthesizer. 

It is another object of the present invention to provide a 
communication system and method and a storage medium 
storing communication system programs, having novel 
functions. 

The other objects and aspects of the present invention will 
become more apparent from the following detailed descrip- 
tion and appended claims when read in connection with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram briefly showing the overall 
structure of a system according to a first embodiment of the 
invention. 

FIG. 2 is a block diagram showing the outline structure of 
a video transmission terminal of the first embodiment. 

FIG. 3 is a block diagram showing the outline structure of 
a video reception terminal (monitor terminal) of the first 
embodiment. 

FIG. 4 is a block diagram showing the configuration of 
software of the first embodiment. 

FIG. 5 shows examples of the display contents on the 
screen of the monitor terminal of the first embodiment. 

FIG. 6 is a diagram showing an example of a map window 
in which a map is displayed at the front of the window. 

FIG. 7 illustrates an operation of starting an image dis- 
play. 

FIG. 8 is a diagram showing an example of the shape of 
a mouse cursor during the image display start operation. 

FIG. 9 is a diagram showing an example of a camera icon 
during the image display. 

FIG. 10 is a flow chart illustrating a power turnoff process. 

FIG. U is a diagram illustrating the operation of changing 
a video display area, 

FIG. 12 is a diagram illustrating the operation of stopping 
an image display. 

FIG. 13 is a diagram showing an example of an image 
display window in a watching mode. 

FIGS. 14Aand 14B are diagrams showing examples of an 
image quality setting panel. 

FIG. 15 is a block diagram briefly showing the overall 
structure of a system according to a second embodiment of 
the invention. 

FIG. 16 is a diagram showing a display example in the 
glance display mode, a synthesized image of images being 
displayed which are supplied from a video transmission 
terminal connected to a plurality of video cameras via the 
synthesizer and switcher. 

FIG. 17 is a diagram showing a display example in the 
glance display mode, a single image being displayed which 
is selected from images taken with a plurality of video 
cameras connected via the synthesizer and switcher to the 
video transmission terminal. 
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FIG. 18 is a block diagram showing the outline structure FIG. 2 is a block diagram showing the outline structure of 

of the video reception terminal (monitor terminal) of the the video transmission terminal 12. Reference numeral 22 

second embodiment. represents a CPU for controlling the entirety of the terminal 

FIG. 19 is a block diagram showing the outline structure 12, reference numeral 24 represents a main storage, refer- 

of software of the second embodiment. 5 $Q ce numeral 26 represents a removable external storage 

FIG. 20 is a diagram showing a monitor example of the uoit such as a flo PPY disk and a CD-ROM, reference 

monitor terminal of the second embodiment. numeral 28 represents a secondary storage unit such as a 

FIG. 21 is a diagram showing a display example when the hard disk > reference numeral 30 represents a mouse as a 

single image display window is popped up. P 01Dtm S device > reference numeral 32 represents a 

np . J. , • j. , i - *u io keyboard, reference numeral 34 represents an I/O board for 

FIG. 22 is a diagram showing a display example in the . J r . . , 4 * . A , 4 - - 

. t . i j • i • u • i a mterface with the camera controller 14 and transfer of a 

single image display mode, a smgle image being displayed t t . t , f . 

which is selected from images taken with a plurality of video cam " a cont ( ro1 sl S n ' and refercDCC num " al 36 "f*""* 

cameras connected via the synthesizer and switcher to the ) ^ ca P ture board for recemng a video signal I output 

, • .„„ ,.„„„„,•„;„„ ,„ ;„,i from the video camera 16. The video capture board 36 or this 

video transmission terminal. ... • * »• e J - 

_„ „, . . . ... , . . 15 embodiment has an A/D conversion function of converting 

FIG. 23 |s a diagram showing a display example m the aQ anal yidco si d ^ a di ^ tal video si al ^ a 

glance display mode, a synthesized image of images being a * • ^ • i n r i 

~. , , , . , , . , . . function of compressing video signals. Reterence numeral 

displayed which are supplied from a video transmission * 0 « • , if _j * j- i • *u 

*\ J . , , r -j • , 38 represents a video board for displaying images on the 

terminal connected to a plurality of video cameras via the r ? An r r ' , ,~ 

, , , ' screen or a monitor 40, reference numeral 42 represents a 

syn esizer an swi c er. 2Q networlc interface, reference numeral 44 represents a system 

DETAILED DESCRIPTION OF THE bus for interconnecting devices 22 to 38, and 42. 

PREFERRED EMBODIMENTS The video board 38 and monitor 40 may be omitted for 

<First Embodiment video transmission only. 

FIG. 1 is a block diagram briefly showing the structure of The terminal 12 constructed as above transmits video 

an overall system according to an embodiment of the 25 signals via the network to a remote video reception terminal 

invention. A digital network 10 transfers digital signals of (monitor terminal) and receives a camera control signal from 

video data and camera control information (inclusive of a remote monitor terminal to control the camera 16. 

status information). The digital network 10 is connected to FIG. 3 is a block diagram showing the outline structure of 

n video transmission terminals 12 (12-1 to 12-n). Each video the video reception terminal (monitor terminal) 18. Refer- 

transmission terminal 12 is connected via a camera control- 30 ence numeral 122 represents a CPU for controlling the 

ler 14 (14-1 to 14-n) to a video camera 16 (16-1 to 16-n). In entirety of the terminal 18, reference numeral 124 represents 

accordance with a control signal supplied from the terminal a main storage, reference numeral 126 represents a remov- 

12, the camera controller 14 controls panning, tilting, able external storage unit such as a floppy disk and a 

zooming, focussing, diaphragm ing, and the like of the CD-ROM, reference numeral 128 represents a secondary 

connected video camera 16. The video camera 16 is supplied 35 storage unit such as a hard disk, reference numeral 130 

with power from the camera controller 14 which in accor- represents a mouse as a pointing device, reference numeral 

dance with an external control signal received from a video 132 represents a keyboard, reference numeral 138 represents 

reception terminal 18 (18-1 to 18-m), turns on and off the a video board for displaying images on the screen of a 

power. monitor 140, reference numeral 142 represents a network 

The network 10 is also connected to m video reception 40 interface, reference numeral 144 represents a compression 

terminals 18 which receive video signals transmitted from decoder for expanding compressed video signals, and ref- 

the video transmission terminals 12 via the network 10 and ere nee numeral 146 represents a system bus for intercon- 

display them on m monitor displays (hereinafter abbreviated necting devices 122 to 132, 138, 142, and 144. 

as monitors) 20 (20-1 to 20-m). The video reception terminal 18 has the same structure as 

The video transmission terminal 12 compresses video 45 the video transmission terminal 12 shown in FIG. 2 except- 

signals output from the connected video camera 16 in a ing that it has no function of controlling the camera and 

predetermined compression format such as H.261, MPEG, receiving camera images, that it has the decoder 144 for 

and Motion JPEG and transmits the compressed video expanding compressed video signals, and that it has different 

signals to the video requesting video reception terminal 18 system software from that of the video transmission terminal 

or to all the video reception terminals 18. The video recep- 50 12. Some or all of the video reception terminals 18 can 

tion terminal 18 received the video signal operates to display transmit a camera control signal to any one or ones of the 

the image in a video display area of the monitor 20. The video transmission terminals 12 or to the terminals 12 

video reception terminal 18 can control, via the network 10, permitted to control their cameras. The video transmission 

video transmission terminal 12, and camera controller 14, terminal 12 received the camera control signal controls its 

various parameters (such as photographing direction, mag- 55 camera 16 in accordance with the contents of the camera 

nification factor, focus, and diaphragm) as well as a power control signal, and sends back the current status of the 

supply (from on to off or vice versa) of any one or ones of camera 16. In accordance with the received status signal, the 

desired cameras 16. The details of this will be later described monitor terminal displays the current status of the camera on 

in detail. the monitor. At the same time, the monitor terminal receives 

A video reception terminal may be realized by providing 60 video data transmitted from the video transmission terminal, 

the video transmission terminal 12 with a monitor and a expands it, and displays it in real time on the monitor screen, 

video expansion device for expanding compressed video FIG. 4 illustrates the software configuration of this 

signals. Similarly, a video transmission terminal may be embodiment. The video reception terminal (monitor 

realized by providing the video reception terminal 18 with a terminal) 18 is installed with camera control client software 

camera controller, a video camera, and a video compression 65 50, video reception software 52, and map management 

device. In this case, it is obvious that software for video software 54. The camera control client software 50 remotely 

transmission or reception is also provided. controls the camera 16 via the network 10 and video 
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transmission terminal 12. The video reception software 52 For example, when the map 60c is selected in the map 

expands compressed video data supplied from the video window 60 and displayed at the front of the window, a map 

transmission terminal 12. The map management software 54 such as shown in FIG. 6 is displayed and camera icons 62e 

displays a camera symbol representative of the current an d 62/ representing two cameras disposed in this map are 

position and status of the camera 16 on a map, and also 5 a is 0 displayed. 

displays an operation panel for controlling the camera 16. A ^ camer a control of this embodiment will be detailed, 

set of above-described software is stored either at the video If an image of a camera 16 & t0 be displayed, the camera 

transmission terminal 12 or video reception terminal 18 m ic0Q of the camera u is selecled m the 6Q b 

its mam storage medium or secondary storage medium. m0 - the mouse 130 tQ Qne of the yideo dis la areas 66a 

V1 ^° rcc ^P tl0n * 0h T?n aU f hc io to 66/in the video display window 64 and releasing the click 

cameras 16 via the network 10 and video transmission u *. ✓ hjj ^j \ u n Au a 

terminalsl2,andstoresfixedinformationofeachcameral6 h * n ™ <«> ca ^ d drag-and-drop). Usually one of the video 

and variable information thereof (e.g., a camera name, a host display areas 66a to 66/not used is selected. However, if the 

name of the computer connected to the camera, a camera vldeo dls P la y area m * elected, a warning is issued to 

status such as pan, tilt, and zoom, a controllable or uncon- the effect that the camera B to be changed, and a user is 

trollable state, a camera name under control, a camera name 15 ur ged to select either "continue" or "stop". The basic opera- 

under display). Such fixed and variable information is also lions of these processes are already known in the field of this 

supplied to the camera control client software 50 and map art. 

management software 54 to change the display of the FIG. 7 illustrates a drag-and-drop operation of the camera 

camera symbol or the like. icon 62c to the video display area 66c. An image taken with 

The video transmission terminal 12 is installed with 20 the camera represented by the camera icon 62c is displayed 

camera control server software 56 and video transmission in the video display area 66c While the camera icon is 

software 58. The camera control server software 56 controls dragged, the mouse cursor changes to a shape shown in FIG. 

the camera 16 via the camera controller 14 in response to a 8 so that the user can recognize the dragging operation for 

request from the camera client software 50, and notifies the displaying an image. The map management software 54 

requested terminal of the current status of the camera 16. 25 notifies the video reception software 52 of an ID of the 

The video transmission software 58 compresses video data camera represented by the camera icon, and the video 

output from the camera 16 in a predetermined compression reception software 52 checks from the ID the direction, 

format and transmits it via the network 10 to the requested name, and host name of the camera and notifies these pieces 

terminal. of information to the camera control client software 50 and 

FIG. 5 shows examples of the display contents of the 30 map management software 54. 
monitor screen of the video reception terminal 18. Reference Next, the operation of controlling a camera will be 

numeral 60 represents a map window showing a layout of, described. Of the video display areas 66a to 66c, as the video 

for example, an office, a store, or a warehouse in which display area (e.g., 66c) in which the image taken with the 

cameras 16 are installed. In this map window, a plurality of camera is displayed by the above operations is single clicked 

maps 60a, 60b, 60c, and 60d can be selectively displayed. 35 with the mouse 130, this designated camera enters a con- 

The number of maps which can be displayed depends upon trollable state. At this time, a yellow frame is displayed on 

the performance of the system and is not limited to a the video display area 66c to notify the user of the camera 

particular number. Each map 60a, 606, 60c, 60a" is provided controllable state, and the camera control panel 68 is auto- 

with a tag. By clicking the tag with a mouse pointer, the map matically displayed. 

with the clicked tag is displayed at the front of the map 40 In accordance with the information supplied from the 

window. The map displayed at the front also displays camera camera reception software 52, the camera control client 

icons (camera symbols) 62a ; 62b, 62c, and 62d of the software 50 accesses over the network the camera control 

cameras installed at this map. Each camera icon 62a, 62b, server software 56 of the video transmission terminal 12 

62c, 62a* is displayed being directed toward the direction of connected to the selected camera. Thereafter, the camera 

the camera 16. 45 control client software 52 transmits over the network the 

Reference numeral 64 represents a video display window camera control signal designated by the user operation to the 

having a plurality of video display areas 66a to 66/ In this camera control server software 56. In accordance with the 

embodiment, six video display areas are used. Obviously the received camera control signal, the camera control server 

number of these areas is not limited to six. A trash-can icon software 56 notifies the current status of the camera 16 to the 

66g is displayed on the video display window 64 in order to 50 camera control client software 52. The camera control client 

stop displaying a camera image. A use method of the software 52 notifies the current status to the map manage- 

trash-can icon 66g will be later described. ment software 54. 

Tlie video display window 64 has two display modes, one The map management software 54 changes the direction 

for displaying all video display areas as shown in FIG. 5 and of the camera icon so as to match the direction of the camera 

the other for displaying only one video image area as shown 55 16, displays a scope 72 shown in FIG. 9 indicating that an 

in FIG. 13 to watch the image in one video display area. The image is under display, and displays a control pointer 74 in 

former is called a glance mode and the latter is called a the scope 72 to be used for the control of pan/tilt and zoom, 

watching mode. The watching mode is used when one image As described earlier, the map management software 54 is 

is viewed as a magnified image or it is viewed at high constantly notified by the video reception software 52 of 

resolution. Switching between the glance mode and the 60 variation information (particularly of pan/tilt information) of 

watching mode will be later described. the camera 16 under display, and in accordance with this 

Reference numeral 68 represents a camera control panel information, the direction of the camera icon 62a to 62/ is 

which is provided with buttons and the like for instructing changed so as to match the direction of the camera, 
the direction (pan/tilt), zoom, and the like of a designated The camera control panel 68 may be used in common by 

camera, and in this embodiment, also with a camera power 65 all the video display areas 66a to 66/ or may be provided for 

button 70 for instructing a power on/off of a designated each of the video display areas. If a plurality of camera 

camera. control panels 68 are provided, the video display areas 66a 
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to 66/ are given specific serial numbers which are given to 
the corresponding ones of the camera control panels 68. In 
this manner, a system can be realized which has a corre- 
spondence between images and camera control panels 68 
easy to understand. Instead of serial numbers, names of 5 
cameras may be displayed or different colors may be allo- 
cated to the video display areas 66a to 66/. 

FIG. 10 is a flow chart illustrating the operation of turning 
off the power of any selected camera 16. If the power of the 
selected camera is to be temporarily turned off, the camera 1Q 
icon of the camera whose power is turned off is selected and 
the camera power button 70 in the camera control panel 68 
is pressed. The camera power button 70 is displayed in 
different colors and/or characters (e.g., "power off" or 
"power on") in accordance with the state of the camera 
power. In response to the operation of the camera power 15 
button 70, the camera control client software 52 notifies over 
the network 10 the camera power-off request to the camera 
control server software 56 of the video transmission terminal 
12 connected to the corresponding camera 16 (SI). 

The camera control server software 56 causes the camera 20 
controller 14 via the I/O board 34 to turn off the power of the 
video camera 10 (S2). The camera power button 70 changes 
its display shape to indicate that the power is in an off-state 
(S3). In this manner, the user is notified that the camera 
power is in the off-state. 25 

If the power is supplied again to the camera in the 
off-state, the camera icon is selected with the mouse 130 and 
thereafter the camera power button 70 is again pressed. In 
this case, a camera power-on request is issued to the camera 
control server software 56 to supply power to the corre- 30 
sponding video camera 16. The color of the camera power 
button 70 is changed to indicate the power-on state. 

In the above manner, the power supply to any camera can 
be controlled by the monitor terminal 18 to save power 
consumption. 35 

In accordance with a video transmission request from the 
video reception software 52, the video transmission software 
58 transmits a camera image. More specifically, the video 
reception software 52 requests the video transmission soft- 
ware 58 of the video transmission terminal 12 connected to 40 
the selected camera over the network 10 to transmit video 
data of one frame. In response to this request, the video 
transmission software 58 compresses the video data of the 
latest frame supplied from the camera and divides it into 
packets which are then transmitted to the requested video 45 
reception software 52. The video reception software 52 
reconfigures the received packets to generate a frame, and 
expands the compressed frame to display it in the designated 
one of the video display areas 66a to 66/ Thereafter, the 
video reception software 52 issues again the video trans- 50 
mission request. By repeating these processes, the video 
reception terminal 18 receives the images at the remote 
camera over the network and displays them. 

If the images of a plurality of cameras are displayed at the 
same time, the video transmission request is issued to the 55 
video display transmission software 58 of the video trans- 
mission terminal 12 connected to each camera, and the 
image is received and displayed. These operations are cycli- 
cally performed for the cameras. 

Changing the display position of a received camera image 60 
can be performed also by the drag-and-drop operation. For 
example, as illustrated in FIG, 11, if the video display area 
66c is to be changed to the video display area 66b, the mouse 
pointer is moved to the video display area 66c. After the 
mouse is clicked and maintained in this state, the mouse 65 
pointer is moved to the video display area 66c whereat the 
mouse button is released. 
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With the above operations, the video reception software 
52 stops displaying an image in the first selected video 
display area (area 66c in FIG. 11), and starts displaying the 
image in the next selected video display area (area 66b in 
FIG. 11). During this operation, the network connection is 
not intercepted. 

In order to watch an image in a particular video display 
area (e.g., area 66a) during the glance mode, this display 
area is double clicked with the mouse. Then, the video 
display window 64 is switched to the watching mode of 
watching the image. FIG, 13 shows the video display 
window in the watching mode. A window 80 is called a 
watching display window. Reference numeral 82 represents 
a mode switch button used for returning to the glance mode. 
Reference numerals 84a, 846, 84c, and S4d represent cur- 
sors for controlling the direction of the camera to display an 
image in conformity with the camera direction. 

In the watching mode, one image is displayed in a 
magnified scale. In this case, it is possible to select either a 
smooth motion display which gives a priority of a display 
speed (frame rate) or a high resolution display which gives 
a priority of an image quality by increasing the data amount 
per one frame. FIG. 14A shows an image quality setting 
window for setting the high resolution display. Reference 
numeral 90 represents a display speed priority button, and 
reference numeral 92 represents an image priority button. 
One of these buttons 90 and 92 can be selected at a time. The 
image quality setting window is displayed on the monitor 
upon instruction by the watching mode. When the display is 
selected in the image quality setting window, a correspond- 
ing image of the watching mode is displayed. 

Next, the operation of the watching mode after the image 
quality priority button 92 is pressed will be detailed. First, 
the video reception software 52 notifies the video transmis- 
sion software 58 of the corresponding video transmission 
terminal 12 of a high resolution request over the network 10. 
Upon reception of this high resolution request, the video 
transmission software 58 switches the transmission image to 
the high resolution. The video reception software 52 
receives the high resolution image and displays it in the 
watching display window 80. In this case, since the high 
resolution image has a data amount larger than the standard 
resolution image, the display speed lowers in some cases. 

As the mode switch button 82 is pressed or the watching 
display window 80 is double clicked with the mouse, the 
video display window 64 resumes the glance mode. The 
video reception software 52 notifies the video transmission 
software 52 of the corresponding video transmission termi- 
nal 12 of a standard resolution request over the network 10. 
Upon reception of the standard resolution request, the video 
transmission software 58 changes the transmission image to 
the standard resolution. 

Next, the operation of the watching mode after the display 
speed priority button 90 is pressed will be described. In this 
case, the video reception software 52 notifies nothing to the 
video transmission software 58. The video reception soft- 
ware 52 magnifies the image transmitted at the standard 
resolution and displays it in the watching display window 
80. The operation of returning to the glance mode is the 
same as the case the image quality button 92 is selected. 

In the mode selection, although the image resolution is 
controlled, an image compression ratio or an image trans- 
mission rate may be controlled. 

Next, the operation of controlling a camera in the watch- 
ing mode will be described. Similar to the glance mode, the 
motion of a camera can be controlled in the watching mode 
by using the camera control panel 68. The camera can be 
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controlled also by pressing the button of the mouse in the a synthesizer connected thereto. Similar to the first 

watching display window. As indicated by broken lines in embodiment, the video transmission terminal 112 is con- 

FIG. 13, depending upon the position of the mouse cursor in nected to a network 110 to which a plurality of video 

one of the upper/lower and right/left areas in the watching transmission and reception terminals are connected, 

display window 80, the mouse cursor changes to one of the 5 i n the first example shown in FIG. 2, one video camera is 

camera direction control cursors 84a to S4d. When the connected to one video transmission terminal In the second 

mouse button is pressed, the direction of the camera is embodiment, four camera controllers 114a to 114d are 

changed to one of the upper/lower and right/Left directions. connected t0 the switcher 10 i and four video cameras 116a 

Although the video reception terminal does not display tQ md are to lhe synlhesizer 102 . 

other images on the monitor during the watching mode, the ^ thesizer 102 ^ ^ described . ^ synt hesizer 

communication with the corresponding video transmission + M i * i • i i- 

terminals is maintained. As a result, when the watching ^ synthesizes moving image analog signals supplied from 

mode is terminated, the monitor can be changed to the v A ldeo j*™ n *" to 1164 as indicated at 166a m HG. 

multi-image display state at high speed. 16 M indicated at 66a in FIG. 17, an image of each video 

It is obvious that in response to a mode change instruction camcra can bc selectively displayed by sending a command 

to the watching mode, communications with the other video 15 fr ° m the v | deo transmission terminal to the synthesizer 102 

transmission terminals may be intercepted to shift to the v * a tne switcher 101. 

image quality priority mode or display speed priority mode. The switcher 101 will be described. As different from the 

Alternatively, as shown in FIG. 14B, a communication keep structure shown in FIG. 2, the structure shown in FIG. 15 has 

button and a communication stop button may be provided in four camera controllers connected to the switcher 101. In 

the image quality setting window in order to instruct, when 20 order for the computer to control the video camera, the 

the watching mode is designated, to keep or stop commu- camera controllers 11 4# to M4d are required to be switched, 

nications with the other video transmission tenninals. The switcher 101 performs this function. As described 

Therefore, in the watching mode, the designated terminal before, as the command is sent to the synthesizer 102, 

can be assigned a broad channel band so that an image of moving image signals from the video cameras can be 

high resolution can be transmitted and an image of a high 25 selected or synthesized. 

frame rate can be transmitted. FIG. 18 is a block diagram showing the outline structure 
If the image display is to be terminated, the image of the video reception terminal (monitor terminal) 118. The 
displayed in the video display area is dragged and dropped video reception terminal has the same hardware structure as 
in the trash -can icon 66g. FIG. 12 illustrates an operation of the first embodiment, but has different software, 
stopping the display of an image in the video display area 30 FIG. 19 illustrates the software configuration of this 
66c. The mouse pointer is moved to the video display area embodiment. The video reception terminal (monitor 
66c and the mouse button is pressed. In the state of the terminal) 118 is installed with camera control client software 
pressed mouse button, the mouse pointer is moved to the 150, video reception software 152, and map management 
trash -can icon 66g whereat pressing the mouse button is software 154. The camera control client software 150 
released. 35 remotely controls the cameras 116a to M6d via the network 
In response to the above operations, the video reception 110 and video transmission terminals 112. The video recep- 
software 54 stops issuing the video transmission request to tion software 152 expands compressed video data supplied 
the video transmission software 58 of the video transmission from the video transmission terminal 112. The map man- 
terminal connected to the camera which displays the image agement software 154 displays a camera symbol represen- 
in the selected video display area (area 66c in FIG. 12). 40 tative of the current position and status of each camera 116a 
Furthermore, the video reception software 54 notifies the to 116^ on a map, and also displays an operation panel for 
image display termination to the camera control client controlling each camera 116a to 11 6«*. Similar to FIG. 1, to 
software 50 and map management software 54. In response the network 110 a plurality of video transmission terminals 
to this notice, the camera control client software 50 discon- 112-1 to 112-n and video reception terminals 118-a to 118-n 
nects the network connection to the camera control server 45 are connected. 

software 56 of the corresponding video transmission termi- The video reception software 152 also manages all the 

nal 12 to clear its video display area (area 66c in FIG. 12). cameras 116 via the network 110 and video transmission 

The map management software 54 erases the scope display tenninals 112, and stores fixed information of each camera 

of the camera icon (e.g., icon 62c) of the corresponding 116 and variable information thereof (e.g., a camera name, 

camera to update the map. 50 a host name of the computer connected to the camera, a 

In this embodiment, the camera symbol in the map is camera status such as pan, tilt, and zoom, a controllable or 

dragged and dropped in the video display area to establish uncontrollable state, a camera name under control, a camera 

the network connection between the video reception and name under display). Such fixed and variable information is 

transmission terminals. The image display position can be also supplied to the camera control client software 150 and 

changed by a drag-and-drop operation between the video 55 map management software 154 to change the display of the 

display area in which a camera image is displayed and camera symbol or the like. A set of above-described software 

another optional video display area. An image display can be is stored either at the video transmission terminal 112 or 

stopped by a drag-and-drop operation from the video display video reception terminal 118 in its main storage medium or 

area in which a camera image is displayed to the display stop secondary storage medium. 

symbol. As above, it becomes very easy to start a camera 60 The video transmission terminal 112 is installed with 

image display, change a display position, and stop an image camera control server software 156 and video transmission 

display. Obviously, images are not limited to only camera software 158. The camera control server software 156 

images, but other images may be used such as images controls the camera 116 via the camera controller 114 in 

generated from a storage medium such as a video tape. response to a request from the camera client software 150, 

<Second Embodiment 65 and notifies the requested terminal of the current status of the 

FIG. 15 is a block diagram showing the outline structure camera 116. The video transmission software 158 com- 

of a video transmission terminal 112 having a switcher and presses video data output from the camera 116 in a prede- 
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termined compression format and transmits it via the net- 
work 110 to the requested terminal. 

As shown in FIG. 15, for the control of the video cameras 
116a to M6d via the switcher 101, the camera control server 
software 156 supplies the switcher 101 with a command for 
selecting a video camera to be controlled, so that the 
switcher 101 is connected to the corresponding camera 
controller of the video camera. Thereafter, in response to a 
request from the camera control client software 150, the 
video camera is controlled by the switcher 101 and camera 
controller 114 connected thereto. 

FIG. 20 shows examples of the display contents of the 
monitor screen of the video reception terminal 118. Like 
constituents to those shown in FIG. 5 are represented by 
identical reference numerals and the description thereof is 
omitted. Reference numeral 110 represents a single image 
display mode button. When this button is clicked, as indi- 
cated at 111 in FIG. 21, a new window is popped up and only 
the selected moving image is displayed. When the single 
image display mode button is clicked, a command for 
stopping image transmission is sent to the video transmis- 
sion terminals other than the selected terminal, and a com- 
mand for increasing a frame rate or raising a resolution is 
sent to the selected terminal in order to efficiently utilize the 
capacity of empty channels. 

Whether the command for increasing a frame rate or 
raising a resolution is determined in accordance with initial 
setting made by a user. Obviously, with this initial setting, a 
balanced setting of both the frame rate and resolution may 
be set. 

In FIG. 20, reference numeral 112 represents a four- image 
simultaneous display button, and reference numeral 113 
represents a selective display button. These buttons are made 
valid only when the video transmission terminal is selected 
which is connected to the four video cameras via the 
synthesizer and switcher shown in FIG. 15. Assuming that 
the image at 66a in the video display area 64 is supplied 
from the video transmission terminal shown in FIG. 15, the 
four-image simultaneous display button 112 and selective 
display button 113 become valid when the image 66a is 
selected by the mouse. 

For example, if the lower right image among the four 
images displayed simultaneously as shown in FIG. 16 is 
clicked and thereafter the selective display button 113 is 
clicked, then the image shown in FIG. 17 is displayed. If the 
image 66a shown in FIG. 17 is clicked and thereafter the 
four-image simultaneous display button 112 is clicked, the 
images shown in FIG. 16 are displayed. 

If the selected tag 60a to 60d has a video transmission 
terminal which does not use the switcher and synthesizer, the 
buttons 112 and 113 are not displayed. A video transmission 
terminal having the switcher and synthesizer is discrimi- 
nated from other terminals by exchanging the current status 
between the video transmission and reception terminals 
displayed when the map is switched. 

Next, the single image display mode will be described. As 
one of the image display areas 66a to 66/ is clicked with the 
mouse 130 and thereafter the single image display mode 
button 113 is clicked, the single image display window 111 
shown in FIG. 22 is popped up and the selected image is 
displayed. 

Next, consider the switching to the single image display 
mode from the state that four images are displayed from the 
video transmission terminal having four video cameras via 
the synthesizer and switcher shown in FIG. 15. The images 
shown in FIGS. 16 and 17 are those images supplied from 
the video transmission terminal shown in FIG. 15. 
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As the single image display mode button 110 is clicked 
while the images shown in FIG. 16 are displayed, the single 
image display window 111 shown in FIG. 23 is popped up. 
Since these images are supplied from the video transmission 

5 terminal having four video cameras via the synthesizer and 
switcher, the four-image simultaneous display button 112a 
and selective display button U3a are displayed in the single 
image display window 111. In this case, if the lower right 
image shown in FIG. 23 is clicked with the mouse and 
thereafter the selective display button 113a is clicked, the 
image shown in FIG. 22 is displayed. 

Similar to switching to the single image display mode, the 
image shown in FIG. 22 has a good image quality because 
of the improved frame rate and resolution effected in 
response to the command. 

15 If the single image display mode button U0 is clicked 
while the image shown in FIG. 17 is displayed, the single 
image display window 111 shown in FIG. 22 is popped up. 
Since this image is supplied from the video transmission 
terminal connected to four video camera via the synthesizer 

20 and switcher, the four-image simultaneous display button 
112a and selective display button 113a are displayed in the 
single image display window 111. In this case, as the 
four-image simultaneous display button 112a is clicked with 
the mouse, four images shown in FIG. 23 are displayed at 

25 the same time. 

In this embodiment, even in the single image display 
mode, images from the video transmission terminal con- 
nected to four video cameras via the synthesizer and 
switcher can be synthesized or selected. Therefore, image 

3Q synthesis and selection can be easily performed by a user 
without confirming whether the operation mode is the single 
image display mode or the glance image display mode. 
<Other Embodiments> 

Programs realizing the structures and functions of the 
above embodiments may be stored in a storage medium. In 

35 this case, a method of realizing the above embodiments with 
such programs and the storage medium constitutes other 
embodiments of this invention. 

Such a storage medium may be a floppy disk, a hard disk, 
an optical disk, a magnetooptical disk, a CD-ROM, a 

40 magnetic tape, a non-volatile memory card, and a ROM. 
Other types of embodiments of this invention include not 
only for the case wherein the embodiment functions are 
realized by executing the program stored in the storage 
medium but also for the case wherein the programs are 

45 executed on an OS together with other application software 
and functions of other expansion boards. 
What is claimed is: 

1. A communication system comprising: 
reception means for receiving images generated by image 
50 generating units of a plurality of communication ter- 
minals; 

output means for outputting a multi-image of images 

received by said reception means to a display unit; 
designation means for designating an arbitrary image 
55 from the images constituting the multi-image; and 
processing means for controlling the output form of an 
image to be output to the display unit, the image being 
designated by said designation means, when a desig- 
nation operation by said designation means is a first 
so designation operation, and for setting the communica- 
tion terminal as a control object, the communication 
terminal generating an image designated by said des- 
ignation means, when a designation operation by said 
designation means is a second designation operation. 
65 2. A communication system according to claim 1, wherein 
said designation means is a mouse and the first designation 
operation is a double click. 
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3. A communication system according to claim 1, wherein nication terminal generating a designated image as a 
said designation means is a mouse and the second designa- control object when a designation operation is a second 
tion operation is a single click. » designation operation. 

4. A communication system according to claim 1, wherein 16. A communication system having a first display mode 
controlling the output form is to control to change the 5 for displaying images received from a plurality of video 
multi-image to a mono-image of the image designated by transmission terminals on a monitor at the same time and a 
said designation means. second display mode for displaying an image received from 

5. A communication system according to claim 1, wherein a n arbitrary one of the plurality of video transmission 
the image generating unit is a video camera. terminals, wherein: 

6. Acommunication system according to claim 1, wherein 1Q when { hc arbilrary one is connected to a synthesizer in the 
the image generating unit is a video recorder. second display mode, an operation area for controlling 

7. Acommunication system according to claim 1, further tne syn th e sizer is displayed on the monitor, 
comprising display means for displaying the mount posi- 17 A commun ication system according to claim 16, 
tions of the plurality of communication terminals, wherein wherein in response to an operation upon the operation area 
said processing means changes the display state of the 1$ for controlling the synthesizer, the second display mode 
mount position of the communication terminal which gen- displays a multi-image synthesized from images supplied 
erates an image designated in response to the first designa- from otQer video transmission terminals connected to the 
tion operation. synthesizer and an image supplied from the arbitrary one. 

8. Acommunication system according to claim 4, wherein 18 Acommunication system according to claim 16, 
said processing means outputs a command to the commu- 2Q wherein the image supplied from the arbitrary one during the 
nication terminal which generates an image designated in second display mode is displayed in a size larger than the 
response to the first designation operation, the command sizes of fr 0m the plurality of video trans- 
being used for controlling to lower a compression factor of m is S i on terminals during the first display mode. 

the image. 19 ^ communication system according to claim 16, 

9. Acommunication system according to claim 4, wherein 25 w h ere in the image supplied from the arbitrary one during the 
said processing means outputs a command to the commu- sccond display mode is displayed at a frame rate higher than 
nication terminal which generates an image designated in the frame rates of images supplied from the p l ural ity Q f 
response to the first designation operation, the command video transmission terminals during the first display mode, 
being used for controlling to increase a resolution of the 2 0. A communication system according to claim 16, 
ima S c - 30 wherein the image supplied from the arbitrary one during the 

10. A communication system according to claim 1, further second display mo de is displayed at a resolution higher than 
comprising control means for displaying an operation area the resolutions of images supplied from the plurality of 
on the display unit, the operation area being used for video transmission terminals during the first display mode, 
controlling the communication terminal which generates an 2 1. A communication system having a first display mode 
image designated in response to the second designation 35 for displaying images received from a plurality of video 
operation. transmission terminals on a monitor at the same time and a 

11. A communication system according to claim 1, second display mode for displaying an image received from 
wherein a predetermined image is synthesized with an image an MbiiT&r y one of the plurality of video transmission 
designated in response to the second designation operation terminals wherein- 

in order to make the image discriminate from other images. 4Q when t ' he one ^ l0 a switcner m the 

12. A communication system according to claim 10, dj& l mo( , aQ ation ^ fof controIli 
wherein said control means displays the operation area lhe switcher i$ ^ , d 0Q the monitor 

affixed with a number or developed with a color, the number 22 A commlmication system according t0 claim 21> 

orcolorcorrespondmgtothecornmunicationtennmal whtch whefein in ^ tQ M ^ tbe tioQ ^ 

generates the designated image. 4J for , he switcher the second disp , ay mode 

13. A communication system according to claim 10, ch , ^ { ^ ^ tQ aQ d from 
wherein when a plurahty of ullages constituting the mulu- anomer videQ transmission terminal c 6 0rlne ^ ed to the 
image are designated by the second designation operation, switcher 

said control means displays as many operation areas as the 23 A commlmication syslem according to c i aim 2 1, 

number of the plurality of designated images. 50 wherein the image supplied from the arbitrary one during the 

14. A communication system according to claim 10. j j* i !L j ■ j * ■ i *l *u 

, . . , , , j- -, second display mode is displayed in a size larger than the 

wherein said control means displays the operation area r* i- j c *l i r. r j 

. . y . 7 . , . , sizes of images supplied from the plurality of video trans- 

corresponding to each communication terminal which gen- {cnnim[s dufi ^ ^ ^ { modc 

erates an un age designated by the second designation 24 A commU nication system according to claim 21, 

operation, by synthesizing information with the operation 55 wher ein the image supplied from the arbitrary one during the 

area, the information being capable of discriminating each second di { mode ^ ^ { d at a frame fate w fler than 

communication terminal from other terminals ^ frame rates of { ^ ffom ^ * Qf 

15. A communication method comprising the steps of: videQ transmission terminals during the first dispIay mode . 
receivmg images generated by image generating units of 2 S. A communication system according to claim 21, 

a plurality of communication terminals; 60 wherein the supplied from the arbitrary one during the 

outputtmg a multi-image of received images to a display second display mode is displayed at a resolution higher than 

umt ^ the resolutions of images supplied from the plurality of 

designating an arbitrary image from the images consti- video transmission terminals during the first display mode. 

tuting the multi-image; and 26. A communication system having a first display mode 

controlling the output form of a designated image to be 65 for displaying images received from a plurality of video 

output to the display unit when a designation operation transmission terminals on a monitor at the same time and a 

is a first designation operation, and setting the commu- second display mode for displaying an image received from 
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an arbitrary one of the plurality of video transmission 

terminals, wherein; 
when the video transmission terminal transmitting an 
image displayed on the monitor is connected to a 
synthesizer, an image synthesis control instruction is 5 
allowed to be entered from an operation area on the 
monitor for controlling the synthesizer, irrespective of 
whether the mode is the first or second display mode, 

27. A communication system according to claim 26, 
wherein the image synthesis control instruction is an instruc- 10 
tion to synthesize a multi-image of images supplied from 
video transmission terminals connected to the synthesizer. 

28. A communication system having a first display mode 
for displaying images received from a plurality of video 
transmission terminals on a monitor at the same time and a 
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second display mode for displaying an image received from 
an arbitrary one of the plurality of video transmission 
terminals, wherein: 
when the video transmission terminal transmitting an 
image displayed on the monitor is connected to a 
switcher, an image switch control instruction is allowed 
to be entered from an operation area on the monitor for 
controlling the switcher, irrespective of whether the 
mode is the first or second display mode. 
29. A communication system according to claim 28, 
wherein the image switch control instruction is an instruc- 
tion to switch an image to another image supplied from 
another video transmission terminal connected to the switch. 

* * * * * 
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